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Abstract 

" The down-going atmospheric and fluxes can be significantly altered due to the presence of 
0>V 2 -scale active-sterile oscillations. We study the sensitivity of a large Liquid Argon detector and a 
^arge magnetized iron detector (like the proposed ICAL at INO) to these oscillations. Such oscilla- 
' ^jions are indicated by results from LSND, and more recently, from MiniBooNE and from reanalyses 
l— Of reactor experiments following recent recalculations of reactor fluxes. There are other tentative in- 
OQications of the presence of sterile states in both the v and 9 sectors as well. Using the allowed sterile 
^"^arameter ranges in a 3+1 mixing framework in order to test these results, we perform a fit assuming 
r-Titttive-sterile oscillations in both the muon neutrino and antineutrino sectors, and compute oscillation 
elusion limits using atmospheric down-going muon neutrino and anti-neutrino events. We find that 
fpr both Vn and v~u) a Liquid Argon detector, an ICAL-like detector or a combined analysis of both 
tectors with an exposure of 1 Mt yr provides significant sensitivity to regions of parameter space in 
^Jie range 0.1 < Am 2 < 5 eV 2 for sin 2 2B W > 0.08. Thus atmospheric neutrino experiments can pro- 
vide complementary coverage in these regions, improving sensitivity limits in combination with bounds 
Cftom other experiments on these parameters. We also analyse the bounds using muon antineutrino 
^^vents only and compare them with the results from MiniBooNE. 

vo- 
m ■ 

^fl.: Introduction and Motivation 

od; 

C§ome significant recent experimental results in neutrino physics (MiniBooNE [1] , reactor i7 e flux recal- 
culation [21 [3] , gallium data [I] , CMB and big bang nucleosynthesis data [5j EJ [7] ) , along with the older 
jpjSND [8] result, have provided evidence of — > v e oscillations at values of L/E ~ 1 m/MeV, where 
• ri-is the baseline and E the neutrino energy. This has motivated the addition of one or more sterile 
K^nti-neutrino(s) with eV-scale mass(es) to the standard 3-flavour scenario. While the experimental 
evidence remains intriguing, no clearly preferred theoretical model or framework has emerged so far. 

These results have prompted a number of global analyses incorporating recent data as well as 
results from earlier experiments, which assume either a framework of three light active neutrinos and 
one ("3+1"), or two ("3+2") sterile neutrinos 0Qia[!31[I21[G2[!Il[ijS[S 

EHE51I251I2Z!. 

Efforts to clarify the situation include plans to put in a new near detector or re-using the existing 
MiniBooNE detector at a near baseline [28]. There is also a proposal to use the ICARUS detector, a 
Liquid Argon time projection chamber at the CERN-PS to look for sterile neutrinos [29J. It has also 
been suggested that a large future liquid scintillator detector like NOi/A or LENA be coupled with 
a compact decay-at-rest source at a short baseline in order to confirm or refute the signals of sterile 
neutrinos |30j. 

In this situation, it is useful to look at experiments which can provide data at multiple values of L 
and E, which would unambiguously signal the presence, or absence, of oscillations. It is also desirable 
to move to a class of experiment with backgrounds and uncertainties which are qualitatively different 
from those encountered in, for instance, MiniBooNE and LSND, or in reactors. 
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Motivated by these considerations, in this paper we study the role a large atmospheric detector 
can play in clarifying these issues. Two examples of such upcoming detectors are the proposed ICAL 
at INO [UJ and a large Liquid Argon detector [32J [33l [34] • For simplicity, we consider the down- 
going muon neutrino and muon anti-neutrino events in the energy range 1 — 20 GeV and baseline 
range 10 — 100 km. This provides a wide band of L/E with values that are relevant to the issues 
at hand. The lepton charge identification capability of such detectors, if magnetized, lends an edge 
by allowing discrimination between the neutrinos and anti-neutrinos, compared to a water Cerenkov 
detector like SuperKamiokande. It allows independent tests of the presence of sterile neutrinos in the 
muon and anti-muon data samples, with higher statistical significance for the former due to the larger 
(by approximately a factor of two) neutrino-nucleon charged current cross sectiorH. 

In the parameter range under study, strong sterile parameter constraints already exist from CDHS 
[35], CCFR [36], MINOS [37l ESI EBj, SciBooNE/MiniBooNE [39] and SuperKamiokande atmospheric 
neutrino data SQl SI] • The present limits are summarized in [16J. Recently, even stronger bounds 
from MINOS+ have been suggested in |42j . and the possibility of sterile neutrino information from 
atmospheric neutrino data in IceCube has been discussed in [43J. Less stringent constraints also exist 
for the sector from MiniBooNe[44, 45J. 

In Section 2, we motivate our study of sterile-scale oscillations using downgoing atmospheric muon 
neutrinos, and give the specifications of the two futuristic detectors we have analysed for this purpose. 
Section 3.1 gives our results for the exclusion limits from these detectors in the sin 2 20 W -Am 2 plane, 
comparing them with bounds obtained from the experiments listed above. 

Since both LSND and MiniBooNE have provided evidence of eV 2 oscillations in the Un sector, we 
separately investigate in Section 3.2 the expected signal from i7„ — > u x , utilizing the charge identi- 
fication capability of such detectors, for a comparison with the bounds from MiniBooNE. Section 4 
summarizes our results and conclusions. 

2 Atmospheric down-going muon neutrinos and the sterile- 
scale oscillation 

Muon and electron neutrinos and anti-neutrinos produced in the earth's atmosphere provide a natu- 
rally occurring source of large fluxes spanning an extensive range of energies and baselines. While the 
upward-going electron and muon neutrinos with baselines of several thousands of Kms pass through 
the earth, are influenced by earth matter effects and give good sensitivity to standard 3-flavour neu- 
trino oscillation parameters, the downward-going neutrinos have baselines of about 15 - 130 Kms. 
With an energy range between 1-20 GeV (above which fluxes become small), these neutrinos lie in the 
L/E range in which oscillations arising from the sterile mass-squared difference may be observed. 

Assuming a 3+1 scheme (one non-standard neutrino with a mass squared difference of Am 2 (= 
Am^) ~ 1 eV 2 ), the expressions for the relevant survival and oscillation probabilities with 2-flavour 
sterile-scale oscillations are [13] : 

= 1 - sin 2 29^ sin 2 [Am 2 L/4£] 

P efl = sin 2 2G eM sin 2 [Am 2 L/AE] 

3 It is not our intention here to assume that there is CPT violation, i.e. that v and v oscillate differently. Our results 
jelow are based on a combined analysis of v + v events. Since the detectors in question can identify lepton charge effectively, 
ve also provide results for v alone, for comparison with MiniBooNE and LSND, which see a signal predominantly in v. 
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where 6 W and Q efl are given by sin 2 29^ = 4|f7 M4 j 2 (l - \U^\ 2 ), sin 2 2Q efJi = 4\U e 4\ 2 \U^\ 2 , and U 
is the 4x4 antineutrino mixing matrix. In the energy and baseline range corresponding to downgoing 
atmospheric neutrinos, the standard 3-flavour oscillations are highly suppressed and one can perform 
the analysis using only 2-flavour sterile-scale oscillations to a good approximation. From [17J, we list 
the following best-fit values and 3<r ranges of these parameters: 

sin 2 20JJ, = 0.083, 0.01 < sin 2 20 w < 0.25 (1) 
sin 2 20^ = 0.0023, 4 x 10~ 4 < sin 2 20 eM < 0.01 
{Am 2 ) bf = 0.9 eV 2 , 0.7 < Am 2 < 7 eV 2 

Here the superscript bf denotes the best-fit values. 

We perform our statistical analysis using two kinds of proposed detectors: 

• A large Liquid Argon detector, which can detect charged particles with very good resolution 
over the energy range of MeV to multi GeV, with magnetization over a 100 kT volume with a 
magnetic field of about 1 Tesla |46j . We assume the following energy resolutions over the ranges 
relevant to our calculations [33j: 

a Ee = 0.01, cte m = 0.01 

<TE had = ^(0.15) 2 /E had + (0m) 2 
o de = 0.03 radians = 1.72°, a 6fi = 0.04 radians = 2.29° 

a 9had = 0.04 radians = 2.29° (2) 

where E e , and Eh ad are the lepton and hadron energies in GeV, oe are the energy resolutions 
and oq are the angular resolutions of electrons, muons and hadrons as indicated. The energy res- 
olution in terms of the neutrino energy is related to the leptonic and hadronic energy resolutions 
as follows: 

<Tu/E v = - y) 2 {a lep /E lep Y + y 2 {o had /E had y (3) 

Here the rapidity or the Bjorken scaling variable y is defined as y = Ei iad /E l/ , where E v = 
Ei ep + Ehad is the energy of the neutrino. The relation E v = E[ ep + Eh ad is exact for quasi- 
elastic scattering and the closest analytic approximation for DIS scattering. Lepton-neutrino 
collinearity is assumed in this procedure, and is expected to hold true to a good approximation 
in the multi-GeV neutrino energy range. Hence the energy resolution in terms of the neutrino 
energy is given by 

o Ev = ^(O.Ol) 2 + (0.15)7^ + (0.03) 2 (4) 

for both electron and muon neutrinos. In our computation, we take the average rapidity in the 
GeV energy region to be 0.45 for neutrinos and 0.3 for antineutrinos |47j . These average rapidity 
values have been verified to be accurate using realistic hadron event simulations. The angular 
resolution of the detector for neutrinos can be worked out to be gq vi , = 2.8°, = 3.2°. The 
energy threshold and ranges in which charge identification is feasible are E t hreshoid = 800 MeV 
for muons and E e i ectTon = 1 — 5 GeV for electrons. 

• An iron calorimeter detector like ICAL, which, like the above detector, offers the advantage of 
muon charge discrimination using magnetization with a field of 1.3 Tesla, allowing a separate 
observation of atmospheric muon neutrino and anti-neutrino events. For this detector, standard 
resolutions of 10° in angle and 15% in energy are assumed. 
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figure 1 : LAr downgoing (J, + H event spectrum vs neutrino energy integrated over the 2 specific cos 9 Z bins with and 
vithout 2-flavour sterile-scale oscillations, using best-fit sterile parameter values. 



The muon event rates are a function of both P MM and P efl , but P efl is highly suppressed due to the 
smallness of the parameter sin 2 2Q e/1 . Thus the downgoing muon event spectrum reflects the behaviour 
of P^n and shows signatures of the sterile parameters 0„„ and Am 2 . In Figure 1, the downgoing muon 
neutrino distribution with and without two-flavour sterile oscillations is shown as a function of the 
neutrino energies, integrated over cos 9 Z bins. 

We assume a 1 Mt yr exposure for both types of detectors, standard detector resolutions as 
above, and flux uncertainties and systematic errors incorporated by the pull method [IB]. The values 
of uncertainties are chosen as in [49]: flux normalization error 20%, flux tilt factor, zenith angle 
dependence uncertainty 5%, overall cross-section uncertainty 10%, overall systematic uncertainty 5%. 
We take a double binning in neutrino energy and zenith angle in the energy range 1-20 GeV and cos 9 Z 
range 0.1 to 1.0. To be consistent with the detector resolution, the bin widths are required to be > 
the resolution widths. For the above neutrino energy and zenith angle ranges, this allows us to take 
20 energy bins and 18 angle bins for these values of resolution width. The atmospheric fluxes are 
taken from the 3-dimensional calculation in |50j . We have taken into account the neutrino production 
height distribution in the atmosphere [51j . 



3 Exclusion limits with sterile oscillations in the and 
event spectra 

One can extract the statistical sensitivity with which experimental-set ups like the ones described 
above may be able to constrain sterile parameters using the downgoing muon and anti-muon event 
spectra as the signal. We perform this study in two stages: 

a) The best exclusion limits possible from this analysis are determined using simultaneously the 
downgoing and P^ event spectra for both kinds of detectors and doing a combined fit. 

b) In order to test the MiniBooNE/LSND antineutrino results, the atmospheric downgoing P^ 
event spectra with sterile oscillations for both kinds of detectors are analysed to determine the sterile 
parameter bounds, and compared with the bounds from MiniBooNE. 



3.1 Limits with a combined v [n analysis 

For this study, the sterile oscillation exclusion limits are computed by combining both the atmospheric 
downgoing muon and antimuon event spectra with sterile-scale oscillations. This involves taking i) 
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Exclusion contours in the sin 2 20 -Am 2 plane with v anti-v events 
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figure 2: Exclusion curves using (a) Liquid Argon and (b) ICAL downgoing muon and anti-muon events with sterile 
)Scillations - Comparison with 99% c.l. limit from atmospheric analysis [TBJUI], 90% limits from SciBooNE/MiniBooNE [35] 
ind MINOS [37], 99% c.l. limit from CDHSW [TBI [35]. 



the 'expected' spectrum Nth, m which sterile oscillations are included, and ii) the 'observed' spectrum 
N ex (no — osc), where 'no-osc' indicates no sterile-scale oscillations. Since we expect no differences 
in the oscillations of neutrinos compared to antineutrinos in the 3+1 model when matter effects are 
absent, we have assumed equal probabilities for them for downgoing events. The exclusion limits are 
presented in Figure 2 for a Liquid Argon detector and an ICAL detector, with an exposure of 1 Mt 
yr for both. Figure 3 shows the results from a combined analysis of ICAL + Liquid Argon. The 
bounds obtained from our analysis are compared with the 99% c.l. exclusion region from atmospheric 
neutrino data pU [9] , the 90% limits from SciBooNE/MiniBooNE [39] and MINOS [37] and the 99% 
limit from the CDHSW disappearance analysis [HI [35] . 

With a Liquid Argon detector and an exposure of 1 Mt yr, regions greater than sin 2 2G W ~ 
0.09 can be excluded at 90% c.l. with a combination of muon and anti-muon events over most 
of the allowed Am 2 range. An ICAL-like detector with a similar exposure gives a weaker 90% c.l. 
exclusion bound at sin 2 20^ ~ 0.15. A combined analysis of the two experiments gives a 3a exclusion 
bound for sin 2 2©^ > 0.11, and a 90% c.l. limit for sin 2 20^ > 0.08, which is seen to be an 
improvement over the earlier bounds obtained from atmospheric neutrinos, as well as those from 
CDHSW, SciBooNE/MiniBooNE and MINOS, over significant regions of the parameter space. Note 
that the sensitivity using this set-up is better in the low Am 2 region (Am 2 < 1 eV 2 ), part of which lies 
outside the present global fit range, but our purpose here is to demonstrate that such an experiment 
is capable of providing significant bounds over the entire parameter space which can contribute to 
constraining sterile parameters in combination with other experiments in a future global analysis. 

3.2 Testing LSND and Miniboone results with sterile oscillations in 
the v sector 

Here we compute the sterile oscillation exclusion limits using the downgoing antimuon event spectrum 
for comparison with the results from MiniBooNE/LSND antineutrino data. The bounds obtained from 
this analysis are presented in Figure 4. The left and right panels correspond to the exclusion bounds 
for the parameters Am 2 and sin 2 20^ with the downgoing spectrum for an ICAL detector and a 
Liquid Argon detector respectively, both with an exposure of 1 Mt yr. Here Am 2 and 0™ denote the 
mixing parameters for antineutrinos. The 90% exclusion limit from MiniBooNE |45] is superimposed 
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Exclusion contours in the sin 2 20 -Am 2 plane with v anti-v events 
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Figure 3: Same as Figure 2 using ICAL + Liquid Argon downgoing muon and antiunion events. 



Exclusion contours in the sin 2 20 -Am 2 plane with anti-v events 
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Exclusion contours in the sin 2 20 -Am 2 plane with anti-v events 
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4gure 4: Exclusion curves using (a) ICAL and (b) Liquid Argon downgoing anti-muon events with sterile oscillations 
'omparison with 90% exclusion limit from MiniBooNE [?S] antineutrino analysis. 



on both figures. It can be seen that this set-up provides a 90% c.l. exclusion capacity with an ICAL- 
like detector with an exposure of 1 Mt yr for about sin 2 2B W > 0.4 for a range 0.1 < Am 2 < 5 
eV 2 , and for a Liquid Argon detector with an exposure of 1 Mt yr for about sin 2 2G W > 0.15 for a 
range 0.1 < Am 2 < 5 eV 2 . Thus a Liquid Argon detector gives stronger bounds than those from the 
MiniBooNE antineutrino analysis. 



4 Summary 

In this paper, we have studied the possible sensitivity of atmospheric neutrino data in a large mag- 
netized iron calorimeter detector like the proposed ICAL at INO and a large Liquid Argon detector, 
to eV 2 -scale active-sterile oscillations. Such detectors are capable of distinguishing lepton charge and 
hence discriminating between neutrino and antineutrino events. With the present sterile parameter 
ranges in a 3+1 mixing framework, down- going atmospheric and events can show signatures 
of eV 2 -scale oscillations, due to their suitable energy and baseline range (neutrinos with multi-GeV 
energies and baselines ranging from about 10 to 100 Kms). Our analysis has been done in two parts: 
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• To be consistent with homogeneity vciv — v behaviour in the 3+1 scenario, we assumed identical 
active-sterile oscillations in both the muon neutrino and antineutrino sectors and derived active- 
sterile oscillation exclusion limits (Figures 2 and 3), comparing them with the limits obtained 

from [EH EZ1 EE1 QZ1 E51 E]. 

a) With a Liquid Argon detector (1 Mt yr), regions greater than sin 2 20^ ~ 0.09 can be excluded 
at 90% c.l. with a combination of muon and anti-muon events, over most of the Am 2 range. A 
3cr exclusion bound is possible for sin 2 2Q flfl ~ 0.13. 

b) With an ICAL detector (1 Mt yr), a weaker 90 % c.l. exclusion bound is obtained at 
sin 2 20^ ~ 0.15 with a combination of muon and anti-muon events. 

c) With a combined analysis of ICAL (1 Mt yr) and Liquid Argon (1 Mt yr), a 90% c.l. exclusion 
limit is obtained for sin 20^ > 0.08 and a 3a bound for sin 2 20 MM > 0.11, which compares 
favorably with present limits from CDHSW, MINOS, MiniBooNE and atmospheric neutrinos. 

• For testing the predictions of LSND and MiniBooNE, we performed a fit with active-sterile 
oscillations in the muon antineutrino sector, comparing the results with the exclusion limits 
from MiniBooNE (Figure 4), and derived the following 90% c.l. exclusion bounds: 

a) an ICAL-like detector with an exposure of 1 Mt yr for about sin 2 20^ > 0.4 for a range 
0.1 < Am 2 < 5 eV 2 , 

b) A Liquid Argon detector with an exposure of 1 Mt yr for about sin 2 20^ > 0.15 for a range 
0.1 < Am 2 < 5 eV 2 . 

The limits for both detectors from an exposure of 1 Mt yr may be accessible in a time-frame of 
about 10-15 years. 

In conclusion, a down-going event analysis using large future atmospheric detectors may be helpful 
in providing significant complementary constraints on the sterile parameters, which can strengthen 
existing bounds when combined with other experimental signatures of sterile-scale oscillations. Such 
a set-up exhibits better sterile oscillation sensitivity in the low Am 2 region (Am 2 < 1 eV 2 ). Evidence 
(or the lack of it) from such detectors has the advantage of originating in a sector which is different 
from those currently providing clues pointing to the existence of sterile neutrinos (i.e short-baseline 
experiments). Additionally, it permits access to a wide-band of L/E, which is important if oscillatory 
behaviour is to be unambiguously tested. 
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